Categorizing digital data collection and intervention tools in health and wellbeing living lab settings: A modified Delphi study.

BACKGROUND: Health and Wellbeing Living Labs are a valuable research infrastructure for exploring innovative solutions to tackle complex healthcare challenges and promote overall wellbeing. A knowledge gap exists in categorizing and understanding the types of ICT tools and technical devices employed by Living Labs. AIM: Define a comprehensive taxonomy that effectively categorizes and organizes the digital data collection and intervention tools employed in Health and Wellbeing Living Lab research studies. METHODS: A modified consensus-seeking Delphi study was conducted, starting with a pre-study involving a survey and semistructured interviews (N=30) to gather information on existing equipment. The follow-up three Delphi rounds with a panel of living lab experts (R1 N=18, R2 - 3 N=15) from 10 different countries focused on achieving consensus on the category definitions, ease of reading, and included subitems for each category. Due to the controversial results in the 2nd round of qualitative feedback, an online workshop was organized to clarify the contradictory issues. RESULTS: The resulting taxonomy included 52 subitems, which were divided into three levels as follows: The first level consists of 'devices for data monitoring and collection' and 'technologies for intervention.' At the second level, the 'data monitoring and collection' category is further divided into 'environmental' and 'human' monitoring. The latter includes the following third-level categories: 'biometrics,' 'activity and behavioral monitoring,' 'cognitive ability and mental processes,' 'electrical biosignals and physiological monitoring measures,' '(primary) vital signs,' and 'body size and composition.' At the second level, 'technologies for intervention' consists of 'assistive technology,' 'extended reality - XR (VR & AR),' and 'serious games' categories. CONCLUSION: A common language and standardized terminology are established to enable effective communication with living labs and their customers. The taxonomy opens a roadmap for further studies to map related devices based on their functionality, features, target populations, and intended outcomes, fostering collaboration and enhancing data capture and exploitation.

Comparative assessment of synthetic time series generation approaches in healthcare: leveraging patient metadata for accurate data synthesis.

BACKGROUND: Synthetic data is an emerging approach for addressing legal and regulatory concerns in biomedical research that deals with personal and clinical data, whether as a single tool or through its combination with other privacy enhancing technologies. Generating uncompromised synthetic data could significantly benefit external researchers performing secondary analyses by providing unlimited access to information while fulfilling pertinent regulations. However, the original data to be synthesized (e.g., data acquired in Living Labs) may consist of subjects' metadata (static) and a longitudinal component (set of time-dependent measurements), making it challenging to produce coherent synthetic counterparts. METHODS: Three synthetic time series generation approaches were defined and compared in this work: only generating the metadata and coupling it with the real time series from the original data (A1), generating both metadata and time series separately to join them afterwards (A2), and jointly generating both metadata and time series (A3). The comparative assessment of the three approaches was carried out using two different synthetic data generation models: the Wasserstein GAN with Gradient Penalty (WGAN-GP) and the DöppelGANger (DGAN). The experiments were performed with three different healthcare-related longitudinal datasets: Treadmill Maximal Effort Test (TMET) measurements from the University of Malaga (1), a hypotension subset derived from the MIMIC-III v1.4 database (2), and a lifelogging dataset named PMData (3). RESULTS: Three pivotal dimensions were assessed on the generated synthetic data: resemblance to the original data (1), utility (2), and privacy level (3). The optimal approach fluctuates based on the assessed dimension and metric. CONCLUSION: The initial characteristics of the datasets to be synthesized play a crucial role in determining the best approach. Coupling synthetic metadata with real time series (A1), as well as jointly generating synthetic time series and metadata (A3), are both competitive methods, while separately generating time series and metadata (A2) appears to perform more poorly overall.

Synthetic Tabular Data Evaluation in the Health Domain Covering Resemblance, Utility, and Privacy Dimensions.

BACKGROUND: Synthetic tabular data generation is a potentially valuable technology with great promise for data augmentation and privacy preservation. However, prior to adoption, an empirical assessment of generated synthetic tabular data is required across dimensions relevant to the target application to determine its efficacy. A lack of standardized and objective evaluation and benchmarking strategy for synthetic tabular data in the health domain has been found in the literature. OBJECTIVE: The aim of this paper is to identify key dimensions, per dimension metrics, and methods for evaluating synthetic tabular data generated with different techniques and configurations for health domain application development and to provide a strategy to orchestrate them. METHODS: Based on the literature, the resemblance, utility, and privacy dimensions have been prioritized, and a collection of metrics and methods for their evaluation are orchestrated into a complete evaluation pipeline. This way, a guided and comparative assessment of generated synthetic tabular data can be done, categorizing its quality into three categories ("Excellent," "Good," and "Poor"). Six health care-related datasets and four synthetic tabular data generation approaches have been chosen to conduct an analysis and evaluation to verify the utility of the proposed evaluation pipeline. RESULTS: The synthetic tabular data generated with the four selected approaches has maintained resemblance, utility, and privacy for most datasets and synthetic tabular data generation approach combination. In several datasets, some approaches have outperformed others, while in other datasets, more than one approach has yielded the same performance. CONCLUSION: The results have shown that the proposed pipeline can effectively be used to evaluate and benchmark the synthetic tabular data generated by various synthetic tabular data generation approaches. Therefore, this pipeline can support the scientific community in selecting the most suitable synthetic tabular data generation approaches for their data and application of interest.

mHealth Apps Using Behavior Change Techniques to Self-report Data: Systematic Review.

BACKGROUND: The popularization of mobile health (mHealth) apps for public health or medical care purposes has transformed human life substantially, improving lifestyle behaviors and chronic condition management. OBJECTIVE: This review aimed to identify behavior change techniques (BCTs) commonly used in mHealth, assess their effectiveness based on the evidence reported in interventions and reviews to highlight the most appropriate techniques to design an optimal strategy to improve adherence to data reporting, and provide recommendations for future interventions and research. METHODS: We performed a systematic review of studies published between 2010 and 2021 in relevant scientific databases to identify and analyze mHealth interventions using BCTs that evaluated their effectiveness in terms of user adherence. Search terms included a mix of general (eg, data, information, and adherence), computer science (eg, mHealth and BCTs), and medicine (eg, personalized medicine) terms. RESULTS: This systematic review included 24 studies and revealed that the most frequently used BCTs in the studies were feedback and monitoring (n=20), goals and planning (n=14), associations (n=14), shaping knowledge (n=12), and personalization (n=7). However, we found mixed effectiveness of the techniques in mHealth outcomes, having more effective than ineffective outcomes in the evaluation of apps implementing techniques from the feedback and monitoring, goals and planning, associations, and personalization categories, but we could not infer causality with the results and suggest that there is still a need to improve the use of these and many common BCTs for better outcomes. CONCLUSIONS: Personalization, associations, and goals and planning techniques were the most used BCTs in effective trials regarding adherence to mHealth apps. However, they are not necessarily the most effective since there are studies that use these techniques and do not report significant results in the proposed objectives; there is a notable overlap of BCTs within implemented app components, suggesting a need to better understand best practices for applying (a combination of) such techniques and to obtain details on the specific BCTs used in mHealth interventions. Future research should focus on studies with longer follow-up periods to determine the effectiveness of mHealth interventions on behavior change to overcome the limited evidence in the current literature, which has mostly small-sized and single-arm experiments with a short follow-up period.

COVID-BIOCHIP: A Web Tool to Analyse COVID-19 Antigen Microarrays.

During the COVID-19 pandemic, there was a growing need to characterise the disease. A very important aspect is the ability to measure the immunisation extent, which can be achieved using antigen microarrays that quantitively measure the presence of COVID-related antibodies. A significant limitation for these tests was the complexity of manually analysing the results, and the limited availability of software for its analysis. In this paper, we describe the development of COVID-BIOCHIP, an ad-hoc web-based solution for the automatic analysis and visualisation of COVID-19 antigen microarray data results.

System Architecture of a European Platform for Health Policy Decision Making: MIDAS.

Background: Healthcare data is a rich yet underutilized resource due to its disconnected, heterogeneous nature. A means of connecting healthcare data and integrating it with additional open and social data in a secure way can support the monumental challenge policy-makers face in safely accessing all relevant data to assist in managing the health and wellbeing of all. The goal of this study was to develop a novel health data platform within the MIDAS (Meaningful Integration of Data Analytics and Services) project, that harnesses the potential of latent healthcare data in combination with open and social data to support evidence-based health policy decision-making in a privacy-preserving manner. Methods: The MIDAS platform was developed in an iterative and collaborative way with close involvement of academia, industry, healthcare staff and policy-makers, to solve tasks including data storage, data harmonization, data analytics and visualizations, and open and social data analytics. The platform has been piloted and tested by health departments in four European countries, each focusing on different region-specific health challenges and related data sources. Results: A novel health data platform solving the needs of Public Health decision-makers was successfully implemented within the four pilot regions connecting heterogeneous healthcare datasets and open datasets and turning large amounts of previously isolated data into actionable information allowing for evidence-based health policy-making and risk stratification through the application and visualization of advanced analytics. Conclusions: The MIDAS platform delivers a secure, effective and integrated solution to deal with health data, providing support for health policy decision-making, planning of public health activities and the implementation of the Health in All Policies approach. The platform has proven transferable, sustainable and scalable across policies, data and regions.

Correction: Beristain Iraola et al. User Centered Virtual Coaching for Older Adults at Home Using SMART Goal Plans and I-Change Model. Int. J. Environ. Res. Public Health 2021, 18, 6868.

The author would like to change the authorship in the previous publication [...].

Development of an Expert Knowledge-Based Genomic Variant Prioritisation Platform.

Considering the growing interest towards next generation sequencing (NGS) and data analysis, and the substantial challenges associated to fully exploiting these technologies and data without the proper experience, an expert knowledge-based user-friendly analytical tool was developed to allow non-bioinformatics experts to process NGS genomic data, automatically prioritise genomic variants and make their own annotations. This tool was developed using a user-centred methodology, where an iterative process was followed until a useful product was developed. This tool allows the users to set-up the pre-processing pipeline, filter the obtained data, annotate it using external and local databases (DBs) and help on deciding which variants are more relevant for each study, taking advantage of its customised expert-based scoring system. The end users involved in the project concluded that CRIBOMICS was easy to learn, use and interact with, reducing the analysis time and possible errors of variant prioritisation for genetic diagnosis.

COLAEVA: Visual Analytics and Data Mining Web-Based Tool for Virtual Coaching of Older Adult Populations.

The global population is aging in an unprecedented manner and the challenges for improving the lives of older adults are currently both a strong priority in the political and healthcare arena. In this sense, preventive measures and telemedicine have the potential to play an important role in improving the number of healthy years older adults may experience and virtual coaching is a promising research area to support this process. This paper presents COLAEVA, an interactive web application for older adult population clustering and evolution analysis. Its objective is to support caregivers in the design, validation and refinement of coaching plans adapted to specific population groups. COLAEVA enables coaching caregivers to interactively group similar older adults based on preliminary assessment data, using AI features, and to evaluate the influence of coaching plans once the final assessment is carried out for a baseline comparison. To evaluate COLAEVA, a usability test was carried out with 9 test participants obtaining an average SUS score of 71.1. Moreover, COLAEVA is available online to use and explore.

An ensemble-based feature selection framework to select risk factors of childhood obesity for policy decision making.

BACKGROUND: The increasing prevalence of childhood obesity makes it essential to study the risk factors with a sample representative of the population covering more health topics for better preventive policies and interventions. It is aimed to develop an ensemble feature selection framework for large-scale data to identify risk factors of childhood obesity with good interpretability and clinical relevance. METHODS: We analyzed the data collected from 426,813 children under 18 during 2000-2019. A BMI above the 90th percentile for the children of the same age and gender was defined as overweight. An ensemble feature selection framework, Bagging-based Feature Selection framework integrating MapReduce (BFSMR), was proposed to identify risk factors. The framework comprises 5 models (filter with mutual information/SVM-RFE/Lasso/Ridge/Random Forest) from filter, wrapper, and embedded feature selection methods. Each feature selection model identified 10 variables based on variable importance. Considering accuracy, F-score, and model characteristics, the models were classified into 3 levels with different weights: Lasso/Ridge, Filter/SVM-RFE, and Random Forest. The voting strategy was applied to aggregate the selected features, with both feature weights and model weights taken into consideration. We compared our voting strategy with another two for selecting top-ranked features in terms of 6 dimensions of interpretability. RESULTS: Our method performed the best to select the features with good interpretability and clinical relevance. The top 10 features selected by BFSMR are age, sex, birth year, breastfeeding type, smoking habit and diet-related knowledge of both children and mothers, exercise, and Mother's systolic blood pressure. CONCLUSION: Our framework provides a solution for identifying a diverse and interpretable feature set without model bias from large-scale data, which can help identify risk factors of childhood obesity and potentially some other diseases for future interventions or policies.

User Centered Virtual Coaching for Older Adults at Home Using SMART Goal Plans and I-Change Model.

Preventive care and telemedicine are expected to play an important role in reducing the impact of an increasingly aging global population while increasing the number of healthy years. Virtual coaching is a promising research area to support this process. This paper presents a user-centered virtual coach for older adults at home to promote active and healthy aging and independent living. It supports behavior change processes for improving on cognitive, physical, social interaction and nutrition areas using specific, measurable, achievable, relevant, and time-limited (SMART) goal plans, following the I-Change behavioral change model. Older adults select and personalize which goal plans to join from a catalog designed by domain experts. Intervention delivery adapts to user preferences and minimizes intrusiveness in the user's daily living using a combination of a deterministic algorithm and incremental machine learning model. The home becomes an augmented reality environment, using a combination of projectors, cameras, microphones and support sensors, where common objects are used for projection and sensed. Older adults interact with this virtual coach in their home in a natural way using speech and body gestures on projected user interfaces with common objects at home. This paper presents the concept from the older adult and the caregiver perspectives. Then, it focuses on the older adult view, describing the tools and processes available to foster a positive behavior change process, including a discussion about the limitations of the current implementation.

NewsMeSH: A new classifier designed to annotate health news with MeSH headings.

MOTIVATION: In the age of big data, the amount of scientific information available online dwarfs the ability of current tools to support researchers in locating and securing access to the necessary materials. Well-structured open data and the smart systems that make the appropriate use of it are invaluable and can help health researchers and professionals to find the appropriate information by, e.g., configuring the monitoring of information or refining a specific query on a disease. METHODS: We present an automated text classifier approach based on the MEDLINE/MeSH thesaurus, trained on the manual annotation of more than 26 million expert-annotated scientific abstracts. The classifier was developed tailor-fit to the public health and health research domain experts, in the light of their specific challenges and needs. We have applied the proposed methodology on three specific health domains: the Coronavirus, Mental Health and Diabetes, considering the pertinence of the first, and the known relations with the other two health topics. RESULTS: A classifier is trained on the MEDLINE dataset that can automatically annotate text, such as scientific articles, news articles or medical reports with relevant concepts from the MeSH thesaurus. CONCLUSIONS: The proposed text classifier shows promising results in the evaluation of health-related news. The application of the developed classifier enables the exploration of news and extraction of health-related insights, based on the MeSH thesaurus, through a similar workflow as in the usage of PubMed, with which most health researchers are familiar.

OBINTER: A Holistic Approach to Catalyse the Self-Management of Chronic Obesity.

Obesity is a preventable chronic condition that, in 2016, affected more than 1.9 billion people globally. Several factors have been identified that have a positive impact on long-term weight loss programs such as personalized recommendations, adherence strategies, weight and diet follow-up or physical activity tracking. Recently, various applications have been developed which help patients to self-manage their condition. These apps implement either one or some of these identified factors; however, there is not a single application that combines all of them following a holistic approach. In this context, we developed the OBINTER platform, which assists patients during the weight loss process by targeting user engagement during the longer term. The solution includes a mobile application which allows users to fill out dietetic questionnaires, receive dietetic and nutraceutical plans, track the evolution of their weight and adherence to the diet, as well as track their physical activity via a wearable device. Furthermore, an adherence strategy has been developed as a tool to foster the app usage during the whole weight loss process. In this paper, we present how the OBINTER approach gathers all of these features as well as the positive results of a usability testing study performed to assess the performance and usability of the OBINTER platform.

Reliability of Supervised Machine Learning Using Synthetic Data in Health Care: Model to Preserve Privacy for Data Sharing.

BACKGROUND: The exploitation of synthetic data in health care is at an early stage. Synthetic data could unlock the potential within health care datasets that are too sensitive for release. Several synthetic data generators have been developed to date; however, studies evaluating their efficacy and generalizability are scarce. OBJECTIVE: This work sets out to understand the difference in performance of supervised machine learning models trained on synthetic data compared with those trained on real data. METHODS: A total of 19 open health datasets were selected for experimental work. Synthetic data were generated using three synthetic data generators that apply classification and regression trees, parametric, and Bayesian network approaches. Real and synthetic data were used (separately) to train five supervised machine learning models: stochastic gradient descent, decision tree, k-nearest neighbors, random forest, and support vector machine. Models were tested only on real data to determine whether a model developed by training on synthetic data can used to accurately classify new, real examples. The impact of statistical disclosure control on model performance was also assessed. RESULTS: A total of 92% of models trained on synthetic data have lower accuracy than those trained on real data. Tree-based models trained on synthetic data have deviations in accuracy from models trained on real data of 0.177 (18%) to 0.193 (19%), while other models have lower deviations of 0.058 (6%) to 0.072 (7%). The winning classifier when trained and tested on real data versus models trained on synthetic data and tested on real data is the same in 26% (5/19) of cases for classification and regression tree and parametric synthetic data and in 21% (4/19) of cases for Bayesian network-generated synthetic data. Tree-based models perform best with real data and are the winning classifier in 95% (18/19) of cases. This is not the case for models trained on synthetic data. When tree-based models are not considered, the winning classifier for real and synthetic data is matched in 74% (14/19), 53% (10/19), and 68% (13/19) of cases for classification and regression tree, parametric, and Bayesian network synthetic data, respectively. Statistical disclosure control methods did not have a notable impact on data utility. CONCLUSIONS: The results of this study are promising with small decreases in accuracy observed in models trained with synthetic data compared with models trained with real data, where both are tested on real data. Such deviations are expected and manageable. Tree-based classifiers have some sensitivity to synthetic data, and the underlying cause requires further investigation. This study highlights the potential of synthetic data and the need for further evaluation of their robustness. Synthetic data must ensure individual privacy and data utility are preserved in order to instill confidence in health care departments when using such data to inform policy decision-making.

A New Approach for Ageing at Home: The CAPTAIN System.

Our work exhibits how previous projects on the Active and Healthy Ageing field have advanced to the conception of CAPTAIN, a radically new approach towards increased end-user acceptance. The goal is to create intuitive technology that does not require specific skills for interaction and blends in with real life. CAPTAIN will be co-designed by all types of stakeholders, including older adults, involved in all stages, from the initial design to delivery of the final system.

Web-Based Interfaces for Virtual C. elegans Neuron Model Definition, Network Configuration, Behavioral Experiment Definition and Experiment Results Visualization.

The Si elegans platform targets the complete virtualization of the nematode Caenorhabditis elegans, and its environment. This paper presents a suite of unified web-based Graphical User Interfaces (GUIs) as the main user interaction point, and discusses their underlying technologies and methods. The user-friendly features of this tool suite enable users to graphically create neuron and network models, and behavioral experiments, without requiring knowledge of domain-specific computer-science tools. The framework furthermore allows the graphical visualization of all simulation results using a worm locomotion and neural activity viewer. Models, experiment definitions and results can be exported in a machine-readable format, thereby facilitating reproducible and cross-platform execution of in silico C. elegans experiments in other simulation environments. This is made possible by a novel XML-based behavioral experiment definition encoding format, a NeuroML XML-based model generation and network configuration description language, and their associated GUIs. User survey data confirms the platform usability and functionality, and provides insights into future directions for web-based simulation GUIs of C. elegans and other living organisms. The tool suite is available online to the scientific community and its source code has been made available.

Modeling Behavioral Experiment Interaction and Environmental Stimuli for a Synthetic C. elegans.

This paper focusses on the simulation of the neural network of the Caenorhabditis elegans living organism, and more specifically in the modeling of the stimuli applied within behavioral experiments and the stimuli that is generated in the interaction of the C. elegans with the environment. To the best of our knowledge, all efforts regarding stimuli modeling for the C. elegansare focused on a single type of stimulus, which is usually tested with a limited subnetwork of the C. elegansneural system. In this paper, we follow a different approach where we model a wide-range of different stimuli, with more flexible neural network configurations and simulations in mind. Moreover, we focus on the stimuli sensation by different types of sensory organs or various sensory principles of the neurons. As part of this work, most common stimuli involved in behavioral assays have been modeled. It includes models for mechanical, thermal, chemical, electrical and light stimuli, and for proprioception-related self-sensed information exchange with the neural network. The developed models have been implemented and tested with the hardware-based Si elegans simulation platform.

Upper limb posture estimation in robotic and virtual reality-based rehabilitation.

New motor rehabilitation therapies include virtual reality (VR) and robotic technologies. In limb rehabilitation, limb posture is required to (1) provide a limb realistic representation in VR games and (2) assess the patient improvement. When exoskeleton devices are used in the therapy, the measurements of their joint angles cannot be directly used to represent the posture of the patient limb, since the human and exoskeleton kinematic models differ. In response to this shortcoming, we propose a method to estimate the posture of the human limb attached to the exoskeleton. We use the exoskeleton joint angles measurements and the constraints of the exoskeleton on the limb to estimate the human limb joints angles. This paper presents (a) the mathematical formulation and solution to the problem, (b) the implementation of the proposed solution on a commercial exoskeleton system for the upper limb rehabilitation, (c) its integration into a rehabilitation VR game platform, and (d) the quantitative assessment of the method during elbow and wrist analytic training. Results show that this method properly estimates the limb posture to (i) animate avatars that represent the patient in VR games and (ii) obtain kinematic data for the patient assessment during elbow and wrist analytic rehabilitation.